• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military

2

Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there

3

'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032

1

Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military

2

Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there

3

'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032

This Startup Wants to Bring ‘Common Sense’ to Self-Driving Cars

By
Renae Reints
Renae Reints
Down Arrow Button Icon
By
Renae Reints
Renae Reints
Down Arrow Button Icon
November 5, 2018, 1:45 PM ET

A little-known name in the world of autonomous driving is paving the way for a new type of self-driving car—one that can use “common sense,” as the company calls it, to navigate an uncontrolled environment.

While most companies developing self-driving cars are focused on improving sensors, perception, and control, iSee CEO Yibiao Zhao says his company is the first to work on creating a robot that can really understand what’s going on.

Zhao founded iSee just about a year ago along with Chris Baker, his lab partner at the Massachusetts Institute of Technology, and Debbie Yu, who has a history with tech startups. The three are supported by MIT’s venture capital firm, The Engine, in Cambridge, Mass.

“We know that seeing is not equivalent to understanding,” Zhao told Fortune in a phone call last week. “Currently cars can see, but they cannot really understand what’s really going on and what other people are thinking, and what are the other people’s intentions.”

With iSee, the cars’ programming has a special algorithm allowing it to collaborate with humans in an open environment. The system has two components: deep learning and the common sense engine.

Deep learning is something other companies like Waymo and Uber have already established; it’s the notion that if you practice something enough, you’ll be able to do it unconsciously. In humans, it’s the fast, subconscious thinking that allows you to multitask while driving. In self-driving cars, it’s the type of learning that lets a car remain within a lane.

When you get to an obstacle, however, you’ll need reasoning, or conscious thinking. When you merge on the highway, change lanes, or come to an intersection, you need to predict the actions of other cars, negotiate with them, and consider different possibilities in order to make a safe decision.

As a human driver, “we’ll consciously think about those types of possible parallel futures,” says Zhao. “That is enabled by our common sense engine in our mind, and that gives us the ability to handle some new scenario that we never encountered before.”

In a self-driving car, the common sense engine allows it to navigate new situations based on a handful of past experiences and general knowledge.

This component, unique to iSee, helps the car to “truly understand what is going on, and to predict what they might do in the next two seconds,” says Zhao. This lets the robot “make safe and strategic decisions when they need to interact or even negotiate with the other drivers in the environment,” he says.

Once Zhao, Baker, and Yu had this algorithm established and passed through a simulator about a year ago, they figured “why not” try it on a real car, says Zhao. Yu generously agreed to let her car, a hybrid SUV, serve as guinea pig.

“We spent just two weeks, and we made the car driving,” says Zhao, laughing as he recalls how cold it was working in the garage in the winter of 2017. “It was a very fun experience.”

Since the success of that first experiment, iSee has gone through multiple variations of programming. The team tests their system with both a simulation engine and manned cars driving in multiple states.

This kind of technology, allowing robots to work fluidly with humans, has potential outside the industry of autonomous cars, but Zhao says iSee is focused on self-driving cars for now.

“We believe the self-driving car is the emerging market. Everyone is working so hard towards it, and the market is ready, the customer is ready,” he says. “What is lacking is this enabling technology, so we want to make this killer application work first. In the future, we can extend it to other applications.”

With the success of the common sense engine, iSee hopes to become widely accepted—without the controversies that have surrounded industry leaders like Waymo, which is reportedly hated by its human neighbors in Arizona due to the cars’ overly-conservative driving.

“I think that’s the open challenge in the field,” says Zhao. “There’s one single piece—that is this core part of the common sense understanding—and I think even Waymo and Uber, those companies, haven’t figured it out yet. We are laser focusing on that and I think that can be the enabling technology to make it really work well in a real-world scenario.”

How soon will that be? “It’s already happening,” says Zhao. “It’s not the future. It’s now.”

About the Author
By Renae Reints
See full bioRight Arrow Button Icon

Latest in

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • Pinterest icon

Latest in

Digital sovereignty isn’t the same thing as digital isolation. Asia’s governments should be careful
Commentarydata sovereignty
Digital sovereignty isn’t the same thing as digital isolation. Asia’s governments should be careful
By Leonard LimJune 10, 2026
5 hours ago
The curse of Trump watching sports in person: the home team seems to always lose
Arts & EntertainmentDonald Trump
The curse of Trump watching sports in person: the home team seems to always lose
By The Associated Press and Will WeissertJune 10, 2026
5 hours ago
Microsoft co-founder Bill Gates (C) arrives for a closed-door interview with the House Oversight Committee on Capitol Hill in Washington, DC, on June 10, 2026.
LawBill Gates
Gates testifies on Epstein: previous Fortune investigation reveals payments to his ex-girlfriend, $1M Microsoft deal
By Eva Roytburg, Joey Cappelletti, Hannah Schoenbaum and The Associated PressJune 10, 2026
6 hours ago
How the World Cup is a high-stakes stage for Big Tech’s AI push
NewslettersCIO Intelligence
How the World Cup is a high-stakes stage for Big Tech’s AI push
By John KellJune 10, 2026
7 hours ago
‘I love the inflation’: Trump is ‘not concerned’ about inflation hitting 4% for the first time since 2023. ‘The numbers were great’
EconomyDonald Trump
‘I love the inflation’: Trump is ‘not concerned’ about inflation hitting 4% for the first time since 2023. ‘The numbers were great’
By The Associated Press and Christopher RugaberJune 10, 2026
7 hours ago
A man guides a ship in the water.
EnergyOil
Analysts expected oil to surge above $200 but China has quietly kept prices half of that—and can’t for much longer
By Sasha RogelbergJune 10, 2026
8 hours ago

Most Popular

Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military
Asia
Pentagon accuses Alibaba, Baidu and BYD, three of China's biggest companies, of supporting the Chinese military
By Kate O'Keeffe and BloombergJune 8, 2026
2 days ago
Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there
Success
Costco CEO Ron Vachris rose from forklift driver to the C-suite without a college degree: ‘Don’t chase a title’ is the career advice that got him there
By Preston ForeJune 8, 2026
2 days ago
'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032
Economy
'We are rapidly running out of time': Watchdog sounds Social Security alarm after 22% cut confirmed for 2032
By Nick LichtenbergJune 9, 2026
1 day ago
Analysts expected oil to surge above $200 but China has quietly kept prices half of that—and can’t for much longer
Energy
Analysts expected oil to surge above $200 but China has quietly kept prices half of that—and can’t for much longer
By Sasha RogelbergJune 10, 2026
8 hours ago
Wall Street dumped nearly $1 trillion in tech stocks by midday—then clawed it back and bought peanut butter and paint
Investing
Wall Street dumped nearly $1 trillion in tech stocks by midday—then clawed it back and bought peanut butter and paint
By Eva RoytburgJune 9, 2026
1 day ago
Current price of oil as of June 9, 2026
Personal Finance
Current price of oil as of June 9, 2026
By Joseph HostetlerJune 9, 2026
2 days ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.